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ABSTRACT 

Three experiments were cocducted to determine the 
effects of student-preferred incentives .^across instructional tasks 
that varied in length and relatedness tc course content. Ihe first 
study was done to determine the effects of the opportunity to earn 
points tpward the .course grade/ There were no differences between 
incentive and no- incentive ^students cc *a.n; leascre.. Experiment 2 was 
designed to investiga^te the effects of student-selected ircentive on 
student^s posttest performance and study' time across twc 
instructional tasks related to course ccntert.- Incentive students 
performed better than no-incentive students on program i^ubtests which 
required stating lists of rules that cculd be committed to memory. 
Experiment 3 was done to determine the effects cf a highlj preferred 
incentive, release from fineil examination, when used under 
instructional procedures in a two- week instructional unit. Effects of 
the incentive were studied on posttest performance, study time, 
student-initiated contact with instructor, and student attitude 
toward the incentives used. Students in the np^incentive condition 
scored higher than incentive students on a constructedr^r espouse 
subtest that required new rules applications. The evidence suggests^ 
that incentives are effective for memory-type tasks, particularly 
when the ,st\ident is aware that rehearsal and memory are task 
requirements. (CSS) 
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each of whom was\alIowed to select his or her prefened incentive from among several aftematives, was compared 
with performance of students in a no -incentive treatment on two course -related instructional programs. Incentive 
students performed significantly (p < .004) better than no-incenfive students on certain program subtests-subtests 
that required the student to state tists of rules that could be committed to ni em cry. In lExperiment 3, the effect on 
stud^ijt performance of release from final examination was investlgate'd under typical in struct iorial conditions in a 
university course. Fifty-nine students studied self-instructional materials and attended optional practice sessions 
during a three-week unit of instruction that- was a regular part of tbe course, hi this experiment, students in the 
no-incentive condition scored significantly higher (p < .04) on a ponstructed-respOnse subtest that required new 
applications of rules than did students in the inceptive condition. As in a typical course, posttest scores vvere applied 
to the course grade for all students, but only students in the incentive condition could earn release from the final . 
examination for acceptable, performance on the test. One finding from Experiment 2 relates to the selectioh of. 
incentives for classroom use. Grade-related and^non-grade-related incentives were described in this experiment in a 
manner designed to hpve high appeal for students enrolled in the course^. The sharply lower^ ratings given potential 
incentives that were/not grade-related (e.g., assisting the instructor, ^atVending a, small groug discussion witl^ an 
authority on a Wgn-interest topic) was consistent with earlier normative ratings of potential incentives obtained by 
the^thor from university students in psychology and education courses. 'However, points toward the course grade 
were preferred over release ffonri a rather comprehensive final assignment in the present study, whereas* subjects in 
the' normative studies had rated release from the final examination higher than points toward the course grade. 
Evidence from these experim'^nts and previous research indicates that incentives are effective for memory-type tasks, 
particularly when the student is aware that rehearsal and memory are task requirements. The unanticipated negative 
effect of incentives in Experiment 3- on a task that required new applications of rules suggests a need for additional 
investigations of the gene ralizability and reliabflity of til is effect^ * » . 
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This research was conducted under project 2^13, Human Resources; 
task 2313-T5 Information Processing arid Cognitive Components of the V 
Flying Task. ^ ■ ^ •'^ \ 

Air Force training programs frequently use intrinsic incentives and 
competition (e.g. , class standing) as motivators. This basic research, . 
while dealing with incentives somewhat different thati those Qsed in Air 
Force Training, is^ directed toward understanding how incentives function 
and how they can be. employed more effectively. The research was carried 
out uflider provisions of contract F41609-75-C-0028 by. the Departrpent of. 
Educational Technology and Library Science, Arizona State University. 
The Air Force contract monitor was Gary B. Reid. 
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EFFECTS OF STUDENT-PREFERRED INCENTIVES IN. UNIVERSITY COURSES 
. / • INTROOUCTION^V - 
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R€ce'nt r^sia^rch in ir1structional>^Vchology i^rapid;fy undermining 
Mhomdike's p.rVnlsiple of IteSM^ing: ^kewards fuhttign' to^/lmprove learning 
. (McKeachie^v 1-974 )V Some studte? in^re^stixi^ting incentive ef^^ drv * V'^ 
learning- tasjjfevifidticate that incentives do ^npt Always /faciK^^^ perfor-"^' 
m|rTi^e (H.il l^V j. l^chman* & Wrkle, . 1973.; Komaki, 1973^ "Sul li van, BaRer, ' 
& SehutZi^49e7i ;iTs:npas^4 Higgiris,* 1974; B.ebe'^iu & Eiij/an-ks/Note -2)' ^'d ]dit^ 
• times/havft -a jdecYe^ effect (Eubfl^^nks, .1976) . effects 
Incentives on 'ipro5lem-solving tasks (Deci, 1971, 7^972.) £Hid' proof- reading • 
jtasks <Wolk S^-puCette, 1974) have alsp heerf observed. . ; ' ' . . 

A significant issue related to eff^ti ve/instruction in college \ 
-courses is the extent to which, available) jnti^ntiv carr be used to - ' 
"ei^hance 'student achievement. Few studied hiivd' in vestn gated the use. of 
incentives in classroom settings for adull: ^earners.^ Laboratory studies 
.;Ofi. incentive effects have" lijnited ^enera/izabil ity* to instructional 
Mttjiigs, ' Grade'-related contingencie^iiresent in the classrobm'are / 
.seldom present \n-^ laboratory studies, /;Wd the incentives used .to moti- " 
'*vate performance in laboratory stu'di^s often are not readily available ' 
'to univ6rsity* instructors, v ' . ' ''^m-' 

Komaki (1973) investigatecl the^effects of incentives theit are 
available to instructfJl^srin universH^^ In her study, delivery - 

of stu^eat-selected incentives' was. fcn-tjngent upon higfi/ perfdirmance on 
.quizzes .fif&t preceded a unit test.. ^Incenttves had a marginal effect on ^ 
iJperformarice' in one of three- courses, komaki at|:Hbuted ,the lack qfJ^' 
differences to a. ceiling effect, Other^^ss^Me exp^anationS^^fo^^ 



failure to obtain 'a significant incentive effect are that' {aj' the^^^^ss- 
roonide live rabble incentives were not of sufficient strength to sign^fi?j 
cantly affect, performfince, (b) the course grade. Vas so powerful that 
incentive effects were ijvp^sked, and (c) the frequent ^tes^ting procedures . 
used in th^^&ttfcdy effectively controlled study behavior and thus^moder- 
a^ted^he pi^tential effect of the incentive. ' ' ^ ' ' 

. , Although /ese^irchers often investigate the effects of varying leveYs 
of a. particuWr incentive (Frase, Patrick, & Schumlr,^1970; Halcomb & 
Bllackwell,-1969; Lloyi;!, GarTington, Lowry, Burgess, Euler, & Knbwltpn, ; 
1^7,2), the learner's perception ot th6 desirabilijty of different incen^ 
tives MS' seldom investigated or- reported. SulTivan^Schutz, and Baker 
(1971) demonstrated that in oi^e* instn/ctiopal program *the effect of an 
incenti ve was dir^ctlVvrelated to the desirabil i ty of -^he incentive. V 



i * * ' '" ^ " 

Until Vlbei<flyfn6mstive w^re not availaS'le on the preferenc^GS of. 
. .^tUtlfents forH'ncenti'ves cofifmor^ly us.,e^ by an -instructor. ' Surveys of, • . ^ , ■ 
stutlent prfeterentes^^cr incentives- avaiTabTe ^fftr use in college class- ^ ; 

^.*ro»ms. (B^p^u.iE^ks-, &-SulliA fn press|j^Bebeau, Sullivan, & Eubanks. 

•1977y,^ev^aled-"that'fncentVves tIftAD.used i^ni tin i vers ity courses are not : 
those tnosK^ref erred by s'tu dents. "Fo^ exam|3^e, these- data indicate that '^^ 
the Qptiort\i^it^ to- serve as a- course' r^icottori pffere-d/i-n many personalized- ^ • 
' .Sys^ni oV-vlnstruction -(PSlO courses ,-«^jsrjTOp<t^ preferred by, students. 
- Simmky, the -opportunity t6 have -i^i i^t chqite .among a selection of" 
'seminars/ offered in a computer-a^siS'ted ijiS'truction ■(CAI ) course at *the . 
■' University "of 111 inoi's (And^rson.;^ Note "n^v^was/not a h1 ghly, preferred 
^•ncentive in the nOmiative «tuiifes. the. cdhtext of Anderson 's CAI 
• "course, hoy/ever, the seminap^'ma^y. be tnore goviepfll than indicated by the , ^ 
' normative/data. ' < * 

■' ' ■ ■ V- ■ ■ • ■ . ■ ■ 

• » ' Several exoerimervtal sti^fives have investigated the effects of the 
types of incefttWes ratedvin the :3ncq,n.t7ve-preference studies by Bebeau 
et'al. (in pre^s;-1977) . i^^The Jresults-, of the ^experimental studies are , 

' generally (insistent with the .o reference data obtained by Bebeau et al. 

• in- that frighVl^referred incert^ive:$'facilit9ted performance, v^ereas 
incehti-ves'with lower. pred^eriflcfe ratings were les^,. effective. The Bebeau . 

>.Vtudies indicate -that gracieVelated incentives are highly\ preferred by ^ 
•-students'.' GoV/ReillyNSi^'benT^an, aad Lehr (1971). , found, that academit . 

- -'p^i^fimance ^ stqdents -is superior when " thgy operate under a traditional 

grading . system as opposed >d^pass--faH-l system. The findings of-Uloyd .. 
"efcaV. (1972) indicate^ tffe-t /toll e^e studenji*" attend lectures With . . . 
: • greater frequen^when^''pf^i>^ts tward, course grade Vai^e used as an ^1^ . 
/ -tive- The Bebaau>t al. data indicaiifi-th^t social incentives (praise, . 

re«<f§nTtioR, etc; )Vwere moderately preferred by uni/versity students. - 
'When selected -on tjae basis of Air* Force trainee preference data collected ^ 

by Wood, Ha1<el, oil Gaizo, and .Klimos^ki (1975); soaal incentives impro, 
ved trainee attitudes, (HakeT, Kl imos^i', & Wood, 19m. not academic 
achievement. The feebeau data also intlicate t'hat fiimd/trila? ,^recogni - 
/■ tion,''and opportunities' to assist the. instrOkor aVe less Pi^eferred thaij 
grade-^elated and social incenti/el. • Wfien Komaki 975) offered events ^ 

• such as choice of projedts. opportunities for extra\credit work, and 
conferences With the an'strtictor as rewards for perf^rmahce on optional 
^^adVri J assignments, these events weice Aiot selected 6> col lege students. 
/Grade -lelated^ents were selected and did enhance performance. 

«». The general purpose oi^ thfe'present research was to determine the, 
effects\of preferred incentives on performance across instructional tasks 
that varV in lenfith. and relatedness' to the course contSnt. In the f-'^rsl^^ 
study, the effects of a preferred incentive, "points toward course grade 

- (Bebeau et al., 1977) were; investT|ated for, tvyo instructional .tasks . 
A course^related-task was,.selectedno deter^infe whether incentives _ 
improve posttest. performance in ^ituati.ons whe>e a/student is already _ 
motivated by 'th^onsequences^afja course.- gr^de.^ *\ task unrelated to the 
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^nsg was selected to determine the effect of an incentive when the stu- 
4erjf had no course-related reason for learning the task. The objective 
""the second, study was* to determine* whether performance on course -related , 
sksMs improved by allowing each student^ tij^ select the incentive he or 
^ wi IT receive for acceptable performance. The' incentives^ offeced w^ere 
_pectfic instances ofithe types /of ificentives rated ih the^ Bebeau .et al . 
(in pVess; 1977) studies. The purpose of^He third study was to investi- 
gate the effects of a preferred incentive' on student performance in'a unit 
of instructix)n that ys a regular part of an on-going c6ui*se. In each study 
the effects of-inGentives on ppsttest performance and study time were 
observed/ * ' • ' . ^ ^ 
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EXPERIMENT 1 , ' ' 

>■ \ ■ ■ ' 

, The purpose of the first study was to determine the effects of V 
availability of points toward the course. grade in a.program that was 
part of the instruction for- a course^ and one that was' not. The efffect^ 
of the "points toward course, grade-" inceritive were studied on student'- 
posttest p^fx)rmancev errors in the instriictional program, , study tirtle. 'and 
attitudes for the coufserrelated program and the unrelated^program. 

Method . V . ' 

^ ■ ' • . ■ ^ . ■■ • ; ~^ ' • ■ ^ ' ( ^' ■ * 

Subjects^ . V ; . v . 

' ■• ' ' . * ■ 

Sutnecfs for Experiment T were 64 graduatg and upper-division' under- 
gradua.tei'^tud^nts enrolled in the Competency-Based Instruction course at . 
Arizona Stated University during the fall semester, 1976;' Participation 
in the experiment was a required class Activity. 

: ' . ■ ^ ■ ■ ^ ' ■ ' 

■ ■ ' / " 
Materials / 

V - The materials used'in the expjsri merit* were a modified version of 
"Moslern.^Measurement'; by Popham (1973) and a modified vfension of the 30- 
frame program "The Structure and Function of the Human Eye" by 0' Day, 
Kulhavy, Anderson, and Malzynski (1971)V Students received feedback on ^ 
the pcactice items CQntained in the^ programmed booklets^^by using mark- 
sensitive answer sheets' and-a special pen for recording responses^ "- 

The posttest for the Measurement Program consisted of five con^^truc- 
ted-response items and 32 two-alternative selected response items. The 
program did not Include practice Qri the cons tjiicted-'re^pon^e items' but. 
instruetional objectives preceding the program indicated that 5uch items 
would be ppesent oa the posttest. On the selected-response items, the 
student was asked to determine which of a pair of concepts was &n appro- 
priate solution for a given situation.. The selected-response practice 
items in' the program :vstere\similar, but not identical , to 'those om the 
test. Instruction WOTv>contained in the program for all test. items of - 
both types. .r\ . ^ 

\ The posttest for the. Eye Program consisted of the same 30 five- 
alternative, multiple-choice items .presented during Instruction., Thjp f 
order of items and the order of the^alternatives were randomized on the. 
posttest,, and consequently differed from 'their order in th^ program. 



*Copies of the modified programs/used in all three experiments have ^ 
been placed on file with Department' of Educational Technology, Box Ff-S, Ari- 
zona State University, tempe, Arizona 85281, and may be obtained upon request. 
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* ^ An attitude %uryeyj consisting^ of nine statements about the instruc- 

. tion and use of the incentive, was a'dministered after each program post- 
/test (Appendix'A) . Statements on the ,two surveys were identical except 
, V jjpor references to the program title. Studeats indicated on a fivei-point 
/' • 'scale the degree to which they agreed or disagreed* with each statement. 

• ' ' . ■ • * . • , 

*■ ■ ■ »■ ■ . ■ * 

• Procedures > 

— '■ — ' 1 — ^ ■ ■. ■ . . . 

In a class period preceding the experiment, students were told that 
in the next two class meetings they would complete two instructional ' 
programs, which would serve as a basis for discussions of instructional 
principles. They vyere. infonned that (a) one program taught jontent rele:f 

'vant to the current unit of instruction, (b) the other prog taught 
content unrelated to the course content, and (c) participation in both 
pr.ograms was desirable for an understanding of certain instructional 
principles that would bepresented later in the course. 
■ . \ ' ■ • . " . "•* 

Upon arrfval in class on the day of the experiment, students were 
randomly assigned envelopes' containing one of ^our sets of. experimental 

.materials. Directions on the envjelbpis indicated assignment to one of 
tvfo classrooms, a procedure used frequently during the course for group 
discussions. The >3nc?nttve and no-incentive treatments were conducted 
in separate rooms to insure that students in the norincentive condition 
were unaware of, the incentive treatment.' Also, s^l^arating students 
% j'nsured that students in the incentive condition would not be influenced 

'by no-incentive studetits who might complete the program more quickly. 
Procedures in the two classrooms were identical, except that students in 
the no-incentive condition were not informed until after they had com- 
pleted their program that they would subsequently have the opportunity 
to earn points toward their course grade. Likewise, students in the 
incentive group were not infonned until after they had completed their 
assigned program that they would subsequently complete the alternative 
program under a no-incentive condition. 

Written difiections at the beginning of each instructional booklet 
were read aloud. These directions, which are contained in Appendix, B, 
indicated that students would be tested over the program as soon as they , 
^ completed it and that only the conterft covered in the Measurement Pro- 
gram would be assessed again at a later date -.^on the unit test and on. 
the final examination. Students ,in the incentive condition were told ■ 
that ^the>| could receive 10 points toward their course grade if they did 
well on t|e test. All students were directed to record the time 
- (written on the chalkboard by ati experimenter at 30-secondnntervals) 
when 4:hey finished the instruction. ^ 

After the reading of directions , students worked through the pro- 
gram and recorded the time at which they completed it. After testing, 
which included completing the attitude survey, students were infonned 

ERIC 



of the incentive condition and directed to report to the alternative 
classroom (two days later) to complete a second instruction^ ^program 
for the next class meeting. - 

The purpose of the-second session was to give the students who were 
'i«n the no-incentive group for the first meeting an opportunity to earn 
the incentive. Procedures used in the follow-up session were identical 
to those used in the experimental session. Because the incentive-group 
students from the experimental session were now aware that the other 
students could receive an incentive for the follow-up session, while 
they could not, it was expected that this awareness might negativeily 
affect their (i.e., the incentive-group students from the experimental 
session) effort and performance. Therefore, the follow-up session was 
not intended as a part of the experiment. However, data are also 
reported in the results section of this session because post hoc 
analyses revealed some findings that were different' frojii those obtained 
•in the e^^.perimental session. 

Resul ts 

The posttest scores, program errors, study times, anti' attitude scores 
were analyzed ysing a 2. x 2 multivariate analysis of variance. i|e fac-. 
tors for the analysis included incentive l|:reatment (incentive antTno- 
incentive) and program (course-related and unrelated). Posttest scores ^ 
were converted to standard scores for purposes of the analysis because 
the total points possible differed for the two program tests. 

. The mul tivariate £ tests indicated that neither the main effect for 
incentive, £ (12, 49) = 1.15;- £ <.34, nor the main effect for program, 
IF (12, 49) = 1.58, £<.13, was significant. The interaction between 
Tncentive and program was also not significant, F (12, 49) = 1-16, 
£_ <.34. ^ 



Posttest Sqores 

Mean scores for each of the dependent variables on the course- 
related (Measurement Program) and unrelated program (Eye Program) are 
?hown in Table 1. Standard scores were used for a comparison of the main 
effects on the posttests. The mean standard score for students in the 
incentive ^up was 52.22 and the mean for students in the no-incentive 
group was 4r.78. On the course-related program, the mean posttest score 
for the incentive group was 36.00 and the mean for students in fhe no- 
incenti,ve group was 33.75^ On the unrelated program, the mean posttest 
score for the incentive group was 22.88 and the mean for students in the 
no-incentive group was 20.50. The mean percentage correct across treat- 
ments was . 79 percent on the course- rel ated program and 72 percent on the 
unrelated program. Examination of the univariate tests revealed that 
none of the differences in posttest performance approached significance. 



Errors . ^ ' 

". On the course-related program (table tbe mean number of in- 
program errors for the incentive group was 4,75, while the mean number 
of i-n-prograrh errors for the no-incentive group was 3,56, On the 
unrelated p^rogram, the mean number of errors for the imcenti.ve group was 
5,.Ct6 and the mean number of errcwrs for the no-incentive group was 4,56, 
The" un/ivariate tests for these differences were not significant for 
either program. 



Study Time t " - 

Comparisons weice made to detertnine whether the incentive or the 
type of program^, influenced the amount of time that students spent studying. 
Mean study times were very similar, varying by only one minute among the . 
fojir treatment groups. 



" Attitude Scores ^ 

Responses to the attitude survey administered after both the experi- 
mental and follow-up sessions are summarized in Appendix A, ' Students 
studying the unrelated program gave significantly higher ratings (2.38 
on the scale of 1 for the highest rating to 5 for the lowest rating). than 
students studying the related program (3.00) to an item dealing with the 
clarity of instruction (Item 6r) . Students studying the^ related program 
rated their level of effort (Item 9) significantly higher. than students^ 
studying the unrelated program. No significant differences in attitude 
were observed between the incentive treatment groups. 



Follow-up Session . 

J ■ ' 

Attendance at the follow-up session was higher than expected for 
students who. had the opportunity to earn an incentive on the course- 
related program during the experimental session, and observations of 
effort suggested that awareness of the experimental conditions did not 
result in a significant reduction of effort by these students during the 
follow-up session. Therefore, post hoc analyses were conducted for this 
session. All but four students attended the follow-up session, and these 
four students made arrangements prior, to the session tocompletp the 
appropriate program at another time. 

The multivariate ^ test indicated that both the main effect for 
incentive, F (12, 49) =2,55, R <.01, and the main effect for program, 
F (12, 49) = 4,52, <.0001, were significant in the follow-up session. 
FTo interaction between ir^centive and program was observed. 



; ' TableJ^ 
Means of Dependent Variables by Incentive and .Program: 
, Experirnental Session, Experiment 1 



Incentive 



Po'sttest Scores^ 



Program Errors 



Instructional Time in Minute 



Treatment Related ,UnreIajLel Totals Related Unrelated Totals Related Unii^elated Totals 



36.00 '22.88' ^ 

■ a ' ■ ■ •■ 

(5h72) (52.72), (52.22) 



No Incentive; 33.75 . ;20.50 

> ■ ■ ■ . ■ 

' [48.28) (47.28) (47.78) 

Totals. * 34.88 21.69 , 

(50.00) > (50.00) '.(50.00) 



4.75 



3.56. 



4.16 



5.06 4.90 37.94 38.28 38.11 



4.56 4.06 36.93 38.09 / 37.51 



-7 



4.81 : 4.' 



37.44 38.18 . 37.81 



Note . Maximum posttest score. for the related program = 44 . 
..- Maximum posttest score for- the unrelated program : 30 
n = 16 for eac^lf. treatment group. ' 



%mb^5 in parenthesis are standard scores. 
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As shown on Table.Z, the mean standard score for the incentive group 
was 50.16 and the'mean^for students in thp no-incentive group was 49.84 
ThiS' difference in posttest scores was not significant. A comparison of 
riiw scores for each program between the experimental sessi on. and the 
follow-up session was also conducted. For each program, the differences 
were less' than one point and were not statistically significant. 

Significant differences associated with incentives were observed in 
the follow-up session for both study time and attitude ratings. Mean 
study time (Table 2) was significantly higher for the incentive group _ 
(37 06 minlites) than for the no-incentive group (31.84 minutes j, L ^ 
= 10 18, p| ,<.Qa2. Students under the incentive condition also gave 
significan'tly higher attitude ratings (Appendix A) than students under . 
the no-incentive condition to items dealing with their level of motiva- 
tion (Item 4), their level of understanding of the program temmology 
(Item 5), and their effort (Item 9). It was expected that differences in 
effort in the follow-up session might- occur between the incentive and 
no-incentive groups ^on the unrelated program. However, inspection of the 
data on page 35 on the motivation and effort items (Items 4 and 9J ^ 
indicate that the significant differences on these items were^due pn- 
marily to differences favoring ;the ^^ncentive" group on the course-related 
program, rather than on the unrelatfd program. .Students rated their 
effort quite high (Item 9) in both\the experimental session (2. Z/J and . 
the follow-up, session (2.17). 
- ■ " . V l» ■ ■ 



Means of Dependent Variables by Incentive and Program: 



^ ^ FollowrUp Session, Experiment 1 



/ 



fettest Scores 



Program Em)rs 



Instructional Time in Minute 



Treatlent Related Unrelated Totals Related/ Unrelated Totals Related Unrelated TotalS' 



Incentive- •35.36 .,22.19 . 

• ^ ;|51.01) (49.30) (50;i6). 

Hp Incentive/ 34.12. 22.75 . . 

i4yil;:i5^ .(49.84). 

1' ^ ■ ■'r . ■ 

, (50.00)* 



fotals 



T 
3.00 



3,06 



3.'97' . 3,- 



33.97 -40.15 



37.06* 



5.12 ^ 4.37 3.74 28.81 34.88 * 31.84* 



4.17^^ 3.61 




3).39** 37.52** 34.45 



M^ i Mmm posttest score for the n^lated program '= 44. 
/ Maximum fiosttest score for the uiireVated^program = 30: 
n = 16 m each treatment group • 



^Numbers in parenthesis are standard .scores. 
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EXPERIMENT 2 



Exp^iment 2 was designed to investigate- the effects of a student/ 
selecte^incentive (as contrasted with the instructor-selected incentive 
offer^in Experiment 1) oq students posttest performance and study 
time across two ins'tructional tasks, both related to course cont^t. . 
The incentives offered were specific instances of the types of incentives 
rated in the Bebeau Qt (1977) study. 

Method 



. Subjects , ' , . 

' j Subjects for this study were the same 64;.students who participated 
in Experiment 1 . Participation in this experiiroat was optional. All 
students elected to^^par-t^i.cipa^te in Experiment 2^ were absent 

when the materials were distributed and two p^etfs failed to attend the 
test session. 



Material s 



• The two instructional programs used \i the experiment were modified 
versions of "Analyzing^ and Sequencing^ Insrtruction" and "Appropriate 
Practice" by Popham and Baker (1970). Instruction and practice exercises 
in- the original progra^ms were mod^i/ied to correspond with the course 
obj^tives. \ ^ - 

A 40-point posttest was const;ructed for each program using items 
from the original tests and .additional items from the course pool of 
items. The test for "Analyzing and -Sequencing Instruction" (Sequencing 
Program) contained 5 selected-rresponse items scored on a twp-point-per- 
item basis and 13 constructed-response items on Which point values varied 
from, item to^item. the. test' for "Appropriate Practice" (Practice Program 
contained ^20 selected-response items (1 point per item) and-4 constf\|cted 
response items on which points varied from item to item. Poilit valti^ on 
the .constructed-response items for both tests' were determined by the 
relative importance of each item to the content. The selected'-respons'e 
items in both programs and on the .posttests involved identification of 
exemplars of given concepts with different exemplars in 1:he practice 
items than on the posttest. Two kinds of constructed-response items 
were included on each program posttest. One type required the student 
to generate instances of concepts for aspecific topic; e.g., give an 
example^ofvanalogous practice for the following objective: "to -give 
a speech." The topics presented in the practice items were different 
from those on the posttest, A second type of constructed-response item 
required the student to state distinguishing characteristi cs , of concepts 




or to state a rulb ior series of rulesjto follow when making the discrimi^. 
nations on the selected-response items. "These constructed-resporjse items 
are memory- type 3 tems and consequently were identical to the practice 
items presented in the instructional matfffials. 

The measure of student incentive Rireferences (Appendix C) prepared 
for this study was similar in form to a portion of the measure designed, 
td gather normative data on student irvcentive, preferences (Bebeau et iij 1 
1977). Six incentives, representative of the. categories presented in the 
preferep.qe study, were selected and operationalized in the context of , 
the^^pwripetency-^Based Instruction, course. The incentives werer 

(1 ) ' :^Re lease from one fin^ application assignment. (Students 
aeeded'to alppiy skills learned in prior units to complete 
/ ^ the three application assignments J . ■ ' 

\ \ ■ ^ . ' " , • - iK> ' ■ ' 

(2v) An option to substitute, th^ score earned^ the posttest for 
the designated experimental ^rogr^im for anyvjjnit test score 
(each test h^s 40 points). , { 

(3) W^Tn*itation to part^cipate in a smal.l group discussion wi th 
the developer of the SWRL-Ginn Kindergarten Readjng Program on 

'^the topic "objectives-ba'sed programs as they relate to individ- 
i^^ual learning styles anh ethnic )ind socioeconomic b&ckgrbund." 

(4) A positive letter of reference for the student's pi acemept f ile< 

(5) An opportunity to assist the instructor , -with the grading of 
application assignments. * / 

(6) No reward. ^ 

Procedures . 

In ai class period preceding the\ distribut^'on of the two self- 
ins tructibnal ^programs, students completed anTincentiye preference measure 
Bsignad ,for this study. After rating each incentive, each student 
seVected the incentive he or she most preferred as a reward for high ^ 
performance .on a course-rel ated, task. Students. were informed ^that they 
could elect to work for this incentive, but that the particular program 
for which .the .incentive could be earned would be predetermined. Students 
were also informed that both programs contained instruction on course 
objectives which would be assessed on the unit test. 

In order to give all students an opportunity to earn an incentive,"^ 
two instructional programs' were selected to study incentive affects. The 
programs were the Sequencing Program and the Practice Program. Each 




student,: completed one program 'under an inc^entive treatment^ and the other. . 
'under* a !;no-in cent ive treatment. To minimize potential order effects, 
inateVials and incentive directions were arranged in booklets so :'tl|at all 
; fOur^?&ossibl e sequences were represented. Students were then randomly 
assigned,;|o. one of the fol lowing orders: ^ . 

' > Sequencing Progrfeim (inc|§ntive) followed by Practice Program 

(no incentive) ; 

. <, • A - -■ ' . . ' ^ >• ■ ' ' . ' . 

{i,). Sequeh^ng Program^ (no-incentive) followed by Practice Program 
. ^ V (1n,cent|\/e); 

. -(3) Practige Program (incentive)^ follov(ed by/Sequenc^ing Program * 
^ ' ^ (nd-incentive) ; ' ' " ^ 

(4)* Practice Program (no-incenttve) followed by Sequencing Program 
' Hncentive). / 

Each student^ received, an envelope containing program materials with 
'directidns to study the materials in preparation for a'' test to be given 
during the next regularly scheduled class meeting (foiir days later))^ An 
instruction sheet preceding the program (Appendix D) for which the incen- 
tive could -bevearne^ informed students of the presence^f the incentive 
conditions.^ Studen.rs we riL informed tHat a posttest score of ' 80 .percent or - 
above' was ret^uired to ^earp the incentive and that it could only beNp^irned 
on the prpgram indicated by the direct^'ons. Students took the materi,als 
home to study them and to complete the practice exercises. They were asked 
to record study time on the practjice exercise form. The two program tests 
were administered during the next regularly sghaduied clasV period. The ^ 
two tests for 6ach student were arranged in j^he same order as the 
Instructional materials. ' ( 

Resul ts V !^ 

. A multivariate analysis of' variance was conducted for each program to 
assess the effects of incentive treatments (incentive vs. no-incentive) on 
posttest scores and study time differences. The multivariate f test for " 
the Sequencing Program indicated a significant effect for incentive, f 
F (5, 52) =2.70, p <.03. The multivariate F test for the Practife ^ 
Tro^ram revealed tFat differences for this program were not significant, ^ 
F (6, 51), = 1.77, £ <.12. , 



Posttest Scores 



Table 3 shows the' posttest mean scores for the Sequencing Program 
for each treatment group on each of the four subtests and on the total 
40y'tem test. The total mean score of 26.17 (65 percent correct) for the 
in&ntive .group was significantly higher than the jnean score of 21.46 
(54 percent correct) for the' no-incentive group,' F ( 1 , 56) =^ 6.28, g_<.01. 



Table 3 

.Posttest Mean Scores by Treatment arta^^Subtest: 
Sequencing Program, Experiment 2 



Points F*bssible 



Subtest .Section 



2 3 
9 17 



4 

10 



Total 
.40 



Treatment 



ncentive . 




No^ncentive 
.Totals 

• / 

* B< .01 • 
**E< .002 



30 
28 



3.36 
3.07 



3.22 



6.00 9.67** 7.13, - 26.17* 
'6:14 5.^9* * 6.36 21 .46* 

6.07 7.7%^~ 6.75 23.82 
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As seen in Table 3, most of the significaiu ^liffererice by treatment' 
occurred on' a subtest section of the program test. On Subtest 3 of the 
Sequencing Program, the mean score of 9.67 (57 percent correct) ^or^ the 
incentive group was significantly greater than the-mean score of 5^,89 
(34 percent correct) fbr the no-incentiye^group, F^(l, 56) = 10.50, 
2.<.002. This difference of 4.7 points accounted for most of the / ' 

statistically significant difference in scores between treatments on the , 
total test. * . A 

The mean postt^t^ stores .for the Practice Program are shown in Table 
4. A mean score for the incentive groitp was 34.96 {si percent correct)^ 
and the mean score for the no-incentive group was 33.43 (83 percent- , • 
correct). The multivariate test indicated no overall incentive differ- 
ences^ However, examination of the univariate tests indicated that, lais on 
the Sequencing Program, differences were apparent on one of the suw:^ste> 
On Subtest 5 of the Practice Program, the mean score' of 7.54 (84 per&irc ^ 
correct) for the incentive group was significantly higher than the mean 
score of 6.03 (67 percent correct) for the no-incentiVe^roup, F (1, 56) = 
8.80, £ <.004. 

Further analysis of the characteristics of the subtest sections was 
performed in an effort to determine the factors responsible for incentive 
differences associated with subtest scores. Table 5 lists the item types ' 
{constructed and selected response) and the performance requirements ^ 
associated with each subtest for two programs. It car\. be seen that Sub- 
test 3 of the Sequencing Pirogram^ and Siibtest 5 of the Practice Prjogram 
both required studepts to st^te one orVore rules ,t 
memorization of several subparts. SuBt^txl on^-the Sequencing Program 
also required the me/norizatipn of rules .^^owever, examination of 'the 
tes't indicated that the rules required . in Subtest?! were simple defini- 
tions which could be cornnitted to memory with. a minimal amount of , 
vrehearsal. Additionally, the section that followed required the students 
to generate instances of these definitions, a process that should help 
commit the rule to mem^ory. The rules the student was required to state 
in Subtest 3 (Sequencing Program) and Subtest 5 (Practice Program) were 
not simple definition types. Each required the students to commit to 
memory several main points and series of subpoints. The sections.; that 
followed these subtests did not require the student to generate instances 
of the definitions as in the case of Subtest 1; of the. Sequencing Program.- 



Incentive Ratings : / ' ^ / ^ 

Mean ratings for each of the six incentives rated prior to the exper- 
iment are presented in Appendix'C. Also shown is the percentage of students 
who selected each incentive as their first preference, the -opportunity to 
substitute a high test score for a lower test score was the first pre- 
ferred of 54 percent, of the students and received the highest mean 
rating (1.58) on the seven-point scale. The opportunity to earn release 
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Table 4 ' , 

pQSttest Mean Scores , by Treat|tient and -Subtest?. 
#' Practice Program, Expermient 2. 



^ — — 

Subtest Section 



Points Possible 



1 
10 



2 
6 



3 

10 



4^ 
5 



5 
9 



Total 



Treatment > 






















. IncentiOt 


30 


8 


.75 


4.85 


9. 


14 


4.68 


7. 


54* 


34.96 


No Incen^tive 


28 


- 8 


.47 


5.10 


9. 


27 


4.'57 


6. 


of* 


33.43 


Totals 




8 


.61 


4.98 


9. 


20 


4.52 


6. 


78" 


34.20 



^£<^.004 




; : : . ' . .: labie 5 . ! ' 

Item Type and Performance Requirement for Each Subtest 
of . the Sequenciirg Program and the Practice Program 



Program 



Item Type^ 



, Sequencing Prdgrafti \ 
Subtest 1 ■ 
Subtest 2 



C 
C 



Subtest 3 
Subtest .4 

PVactice Program 

Subtest 1 

Subtest 2 

Subtest 3 , 

Sub'test 4 
■ Subtest 5 



S 
C 
S 
S 
C 



Performance 



state rules #l/and #2 

gei^ate ipstancei? of rules; #1 ■ 

#2 V . • 

state rules #3-6 (each rule has. 

several subparts) 

iderlttfy instances of rules #3-:6 



I. 



identify instances af rules #1-4 
generate instances of rules #1-4 
identify' instances of rule ^#5 
identify inststhces. of i^Je #6 
itate rule #6 {rule has several 
subparts) 



= constructed response; S = selected response 



f^rom an assignment was. the first preferred by 35 percent of the studenfs 
and had a mean rating of 1.66. Students- rated the- opportuni ty +0 earn a 
letter of reference favorably (2. 50) ■,but only ' 11 percent of the students 
selected It as theirlfirst preference. Th6 other two incentives and the^ 
no-reward option, were not selercted by any student and had relatively low.- 
'"^3\'"3t:i.ng^. .The Pearson product-moment correlation between the r&tings' 
•of these SIX specifidally described-incentives and the normative ratings ' 
of the SIX corresponding incentive categories -^in the Bebeau et al. (1977) 
study^was .85,«indicating high consistency of preferences between'.student<: 
in this study and those in the normative study. ' 



Instructional Time v " 

.. L ■ -N- ' ■ ■ ■■ ■ - 

Time spent studying the instructilanal materials, was recorded by all 
students. Althou^gh stufaents in the intentive group for 'the Sequencing 
Program averaged 14 minutes longer thsfn students in the no-incentive 
group (73.46 to 59.46) , this difference was not statistically significant, 
F (1, 56)'= 2.87, £^ <:09. Mean ;study times of 54.79 for the incentive 
g.roup and 53.47 for the nb-incejitive group on the Practice Program were 
not significant. - % 




EXPERIMENT 3 



The- purpose of Experiment 3 was to determine the effects of; a 
highly preferred incentive, re^lease from final examination OBebeay et 
al., 1977), when used under typical instructional procedures in a unit 
of instruction of approximately two weeks duration in a one-semester 
university course. Effects of the incentive were studied on posttest 
performance, study time, student-initiated contact with the instructor, 
and student attitude toward the use of incentives^^ 

Method • 



Subjects . 

Subjects for this experiment were 59 upper-division undergraduate, 
ptudents enrolled in. the Competency-Based. Instruction course at Arizona 
State University during the spring semester, 1977. Both daytime sections 
were taught by the same instructor with the aid of a 'graduate teaching ■ 
^^^siTistant. . , 

Materials , 

For purposes of this experiment, the regular instructional materials 
for the second unit of the Competency-Based Instruction course were pre- 
pared in "a self-instrAictional ' programmed fomat. Much of the content of 
the self-instructional program had undergdne extensive tryout and revision 
during the three years the course had been taught. The program contained 
instruction, practice exercises, and feedback for the fou^^unit objec- 
tives listed below: 

(1) to distinguish between instructional objectives and instruc- 
tional activities; , 

(2) to identify worthwhile instructipnal objectives; 

(3) to identify well-written instructional objectives; 

(4) to write instructional objectives. 

■ ■ "... 

■Since feedback on the fourth objective ci9uld. not be given most effectively 
in self-instructional format, two of the three optional practice sessions 
provided additional practice and feedback on this objective. Students 
could elect to attend one or more of these sessions. 

Three practice exercises were prepared for the optional practice 
sessions. Exercise 1 contained 30, items— ten selected-response items 
for each of the first three objectives. Exercises 2 and 3 were identical 



in fbrm, each containing five constructed-response items for the fourth 
objective. • 

' The 40-point posttest for the unit consisted of 10 two-alternate 
selected-response i'tems (one point each) for each of the first three 
unit objectives and five constructed-response items (two points each) 
for the fourth objective. The total score for the t^est was 40 points, 
10 points for each subtest. 

■ An attitude survey, consisting of 11 statements about the instruc- 
tion, practice sessions , and use of the incentive was administered to 
students at the end of the unit test. Students^were asked to indicate 
on a five-point scale the degree to which they agreed or disagreed with 
each statement. A copy of the attitude survey is included in Appendix E. 



Proc edures v 

The incentive for this experiment was the opportunity to earn 
release from, the course final examination. During the semester each 
student was given one opportunity to earn this incentive for good' perfor- 
mance (80 percent correct) on a unit test. For the purpose of this 
experiment, half the students werer^ven an opportunity to earn the 
incentive Oh Unit 2. The other half could earn the incentive for good 
performance on either Unit 3 or Unit 4— the particular unit for which 
they could earn it was randomly assigned. Attaining the criterion 
Score on the particular test for wKich the incentive could be earned 
meant that th^ student was. exempt from taking the final examination 
and automatically earned a perfect score! If the established criterion 
was not met, the student took the final examination and was assigned 
only the total points obtained on the test. Students who did not have 
the opportunity to earn release from the final examination on ynit 2 
served as the no-incentive group. However j points obtained on the Unit 
2 test counted toward the course grade for both the incentive and no- 
incentive treatments. ^ 

The Competency-Based Instruction course was ^divided into five units. 
During an introductory unit, course procedures and the characteristics of 
a competency-based* instructional program were described. There was no 
formal assessment for this introductory unit, whlcK'was completed during 
the first two weeks of the semester.. Time for the second unit, the one 
during which the experiment ;was conducted, was three weeks. 

During the first class meeting of the spring semester a course 
syllabus listing course objectives, course requirements, and the basis' for 
determining grades was distributed to both sections. Total points ..accu- 
mulated on four unit tests (each worth 40 points) and three application 
assignments (each worth 20 points) were the basis for grade assignment. 
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To help students estimate the value of the performande-contingent incen- 
tive .offered as a part of the experiment, students were informed of the 
estimated range of scores for course grades (195-220 points = A, etc.). 
These sCbrts were estab-llshed on .the basis of past performance in the 
course. # 

. Students were ^ffetested during the second class meeting on a measure 
that included items selected from practice njaterials us* during the 
course. After the pretest, the information related to the opportunity 
to earn release from the final examination for good test performance was 
,given. The particular unit test for which the incentive could be earned 
varied between treatment groups, but all students were infortned of the 
presence of the incentive condition and the unit on which the incentive 
could tfe earned prior to instruction on Unit 2. 

Prior to the beginning of UnTj^Z, students in both sections were 
randomly assigned to the incentive and no-incentive treatments. Exami- 
nation of the pretest scores, (13.2 for the incentive group and 14.1 for 
the no^incentlve group) indicated no significant performance difference 
between the groups./ Self-,instructional materials, directions for using 
the materials^ and a schedule of the unit activities were distributed - 
at the beginning of the unit. 

The directions described the presence or absence of the opportunity 
to earn an incentive for good program perfomiance. Guidelines for 
working through the program and for deciding whether to , attend the 
optional practice sessions were also included. The guidelines informed 
students that if they did well in the program, it was an indication they 
would do well pn the test, but that if they missed several items in the 
program, it was likely that they could profit from the optional practice 
sessions. AIT students were told that they were welcome to participate 
in the optional sessions even if they did extremely wel 1' throughout^ the 
program. 

The unit schedule given to students listed the date that the test 
would be given and the dates and a description of the three optional 
practice sessions. One session was scheduled for revjew and additional 
practice on the first three objectives, and two sessions were scheduled 
for review ai\d additional practice on the fourth objectives. Complete 
directions an^ the schedule are included in Appendix F. 

. The test was administered two and ohe-half weeks after the materials 
were distributed. The attitude scale was given immediately after the 
test. The last class pertod on the three-week unit was used to provide 
feedback on the test. 



■ Design and Data Analysis ^ ' 

•The design for this study was a p^etest-tredtment-posttesfexperi- - 
.'mental, design with random assignment of students to incentive and no- 
iacen^ive treatments. A multivariate analysis of variance was used .to - 
assesis the effects of incentive -treatments -on (a) posttest performance, 
(b)..study time, and (c) attendance at optional practice sessions. 

V . " < • Results <> 

The multivariate Po test indicated ^ significant effect for incen- 
tive ,i^-F (6. 52) = 2.49, <.03. The' means obtained by the two treatment 
groups on each of the dependent measures are shown irt Table \, The 
difference in mean \S,cores between the incentive group (34.46) and the 
no-incentive group. {35. 20) was less than one point. The overall mean 
percentage correct Was 87 percent. 

Because incentive differences were previously observed on construe- , 
ted-response items, an analysis of subtest scores was also included. 
Examlnairioh of the univariate tests indicated a statistically significant 
difference, F_ (i , 57).= 4.31, <.04, between the mean score of 9.17 k 
attained on Subtest 4 by the no-incentive group and the mean incentive ^ 
group score of 8.53. The. significant difference on Subtest 4 was not in .i 
favor of the incentive group, as had been the case with^constructed- • ' ■ 
response items that required the memorization of rules (Experiment 2). 
Subtest 4 required students to construct examples of . instructional 
objectives when given subject-matter topics. Since pre-instructional 
differences On Subtest 4 could account for the observed post-instructional 
difference, an analysis of pretest subtests was also. performed. ^The means 
and vari^inces for the incentive (2.30, SD = 1.95) and no-incentive groups 
(2.34. SD. = 2.15) Were nearly identi cal~5h the pretest. 

Table 5 also contains data on mean study time, program errors , and 
attendance at optional practice sessions. Students in the incentive 
group spent an average of 56 nfinutes longer studying the materials than, 
students in the no-incentive gV-bup (266 minutes to 210 minutes), ^ dif- 
ference that was not statistically significant. The average number of- 
errors while. xopipVeting the pro,gram was 5.16 for the incentive group and 
,6.13 for the no-incentive group. Students in the incentive group attended 
an average of 1.95 practice sessions as compared with 1.51 sessions 
attended by the no-incentive group. Neither the difference in program 
errors nor the difference in practice sessions was statistically 
significant. i^., .' " 

Responses to the attitude survey are summarized in Appendix D, In 
general, students responded favorably to the instruction -and use of the 
incentive. .The only significant differ.ence occurred on Item 7, "The 
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Treatment. ^ 
•Incentive 

I 

No Incentive 
Totals 



Table 6 



Means of Dependent Variables by Incentive Condition: 

ExRjsriment 3 , 




Pes ttest Scores 



_iubteslSect^ . 
1_J_ X 4, Totjl 



1.96 



30 8.97 8.60 8.36 8.53* , 34.46 
29 m 9JZ 8J7 3^20 

^.78 8.87 8.32 8.85 34T8V 1^74 



Attendake? J!I9!1 
5.16 

6J3 

5.66 



Note . Maximiiin Ppsttest Score 40 (10 for each Subtest), 
astuilent attendance at 3 optionaf practice sessions. 
*P< .04, 



* . ..... ^ ■ . . . ^ 

P'^fc^'ice. sessions increased my understanding of the materials," which was 
Wed significantly higher by students in the no-incentive group (mean 
I/li?^ ' "'•28) than by those in the incentive groupr(mean = 1.72),, 
t(40) = 2.42, p <.02. - ^ ' : 
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DISCUSSION ' 

'^^ The present research was conducted to detennine the e^ffects of 
preferred incentives on. the performance of college studeats across 
.instruotional tasks that varied in length and relatedness to the course 
nnni^J^ Grade-related contingencies are present in the no-inceVitive > 
condition when course-related materials arexused,. so incentive differ- 
ences wer6 expected to be more evident for [Material that was unrelated - 
to the course than for material that was course-related. Students 
OTTered an incentive were expected to demonstrate greater effort and • 
consequently*better posttest performance. Student reports of, effort 
expended and reports of study time were' collected to insure sensitivity " 
• to incentive differences that may be masked by factors related to instruc- 
tional effectiveness. Significant relationships between incentives and 
perrqrmance w^re observed on four of the five instructional tasks 
pmpioyed-in these experiments. However, the overall effects of incentives 
were not ejtactly as predicted. / 

In, the first study, no significant differences were noted in pese- 
tas t performance on either a course-related or an unrelated ±ask when 
points toward , the coursd' grade were used as an iiKeritive.^. In the second 
study, performance^of students under. a self-selec^^nQOntingency was^ 
compared with students that were in a no-incentive treatrnent on two 
course-related tasks. Incentive students performed significantly better 
tnan no- incentive students on certain program Subtests— subtests that 
Fy^l^m student' to state a-list of rules that had been memarized. 'in 
experiment 3, the effect on student performance of release from final 
■examination was investigated under typical 4fl?tructional conditions in a 
university course. In this case, students in\the no-incentive condition 
scored significantly higher than students in the incentive condition 
on the constructed-response items for this instru^ltional task. 

\ Incentives appeared to affect perfprmancJ on certain types of 
Items. Four kipds of constructed-resporise and ..two kinds of selected- 
response items were present in the five instructional programs used to 
incentive effects. On^ constructed-response items that required 
students to memorize, a lengthy set of rules (Experiment 2), incentives 
clearly facilitated performance (^ <<^04).. Conversely, on constructed- 
response items that required students to apply a series of rules, when 
generating examples that conf-ormed to the rules (Experiment 3), perfom- 
ance was significantly higher under a no-incentive condition, though the 
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difference was not of great magnitude nor as evident fir'om the raw scores. 
No significant differences were observed for constructed-responsfe items 
that required students to define a simple concept or generate instances 
of ^ single cbncep'^. . 

There is evidence from paired-as^s^i ate studies (Cuvo, 1973) that 
incentive level influences rehearsal and that rehearsal , ^" turn, influ- 
ences word-recall scores. However, word-recall scores were not affected 
by incentive level in the absence of rehearsal opportunities. In each 
of the present experiments, study time was allowed to vary. On the ' 
Sequencing Program (Experiment 2), where incentives had th^ most ■ 
noticeable effect on constructed-response items of the memory^ type (i.e.,' 
rpcalT-type items ^as in the Cuvo study), the reported mean study time,of 
students in the incentive group was 14 minutes )onger than that of 
students in the no-incentive group. Although this difference in reported 
study time was not statistically significant, it seems possible that the 
longer study time of the incentive Jiroup may have influenced their 
performance on the recall-type constructed-response items. 

■ ' ■ . ■ '■^ 

Incentives did not facilitate performance oii selected-response items 
in any of "the experiments. The facilitative effect of incentives, on 
selected-response memory-type items was observed by Raid- He 
noted that, under conditions of high reward, students requested additiop'cfl 
review time and used it to stud^rthe test questions and answers. . TheX 
selected-response items in the Eye Program (Experiment 1) wer§.4Tiemoiy^ 
type items, but no significant differences for measures of efforToK 
performance were obtained on this program, it may be that students were 
unaware that rehearsing the' items would assist them in answering t|e . 
test questions. Selected-response items' in the other programs were 
concept-classification items. ' It seems probable that performance is less 
likely to be affected by differences in rehearsal time on concept- 
classification items than on memory items because the former require the 
application of concepts rather than memorisation of factual information. 
Additionally, increases in effort on concept-classification items maybe • 
moderated by factors related to the design of instruction , such as the 
care with which practice and test items are selected from a domain of 
items, the extent to which the instruction facilitates concept attainment, 
and whether the test coV^taii^s new exemplars ^f concepts in contrast to »' 
previously enqountered exemplars. . ^ M 

The negative finding on a task that required new applications of a 
large number of rules was not expected. Caution must be taken in inter- 
preting these results since the significant difference (£ <.04) y/as 
based on a .64-point' difference between the groups on a 10-point subtest 
containing five items, previous observations of an incentive decrement 
effect are reported by Eubanks (1976) on a task that required new applica- 
tions of visual ly-prese^ited and verbally-presented concepts. Incentives 
had consistently facilitated some aspect of performance in earlier studies 
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using the same task (Reiser, '1975; Tenpas & Higgins, 1974h but when 
Eubank| studied incentive effects- with students who had low pretest 
score^on the task, the effect of incentives on performance was nega- 
tive. In the present Research (Experiment 3), low pretest s^res 
inflicated that these students also were unable to perform the task prior 
to instruction. . Whether negative incentive effects may occur frequently , 
in situations in which students are reguired to make new applications of 
concepts that are highly unfamiliar prior to instruction is speculative. 
Strong confidence in^the reliability and generality of such an effe^^t 
should be contingWt on fi^rther observat'ions of its occurrence. 

An expected "consequence of an effective incentive is an observable 
increase in effort. In the experimental session for Experiment 1 , no 
significant differences in effort were reported for either the course- 
related or unrelated task. In the follow-up session, significant differ- 
ences in effort v^ere reported for the' incentive group on the course- ^ 
related task, but there w^is no evidence that the additional' effort 
improved posttest performance. On the course-related task, both the 
incentive and nq-incentive groups performed poorly on items that^required 
the stating of definitions. The program did not include practice items 
that required the student to state the definitions. Though objectives 
preceding ythe program indicated that the ability to state defintriTohs 
would be assessed on the test, studen^tsf evidently failed to use this 
information in a'manner that resulted in increasedAeffoVt and effective- 
ness in learning the definitions. 

On the unrelated program, students under the incentive condition \ 
were expected to demonstrate significantly greater effort and conse- 
quently better ^j^rformance in both the experimental and follow-up 
sessions. Yet, the availability of points tcMard the course grade did 
not result in significantly higher posttest performance than whatever 
motivated students in the no-incentive group to study the unrelated 
iliaterial. The high attendance at the fol low-up\session among no- 
incentiye students in the unrelated program indi\ates higher-than-expect6d 
motivation among these students. Perhaps the motivation resulted in part 
from the instructor's statement that the experimental materials would 
form^the basis for later discussions of instructional principles. 

One important finding relates' to the selection of incentives for 
classroom use. , Grade-related incentives are the most preferred from 
among the types of incentives available to classrcoom instructors. In 
Experiment 2, an -attempt was made to describe both grade-related and 
jion-grade-related incentives in a manner that would have high appeal for 
students enrolled in a particular class. The sharply lower ratings 
given potential incentives that were not grade-related were consistent 
with earlier normative ratings of 'the incentive categories.. None of 
the students elected either the opportunity to assist the instructor or 
the invitation to attend a discussion with an authority on a high-interest 
topic. Only a few students selected a favorable letter of reference as 
their first preference. 
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Thofugh overall student preferences for incentives in Experiment 2 
were quite consistent with the preferences Indicated in the earlier 
normative studies by Bebeau et al. (in press; 1977), ^here was a varia- ; 
tion With respect to the grade-related incentive and release from the 
final examination. I" study, a larger percentage of students 
^•selected the option to substitute a potential high score for a previously 
earned low score than the option to earn re^ase from a fipgl course 
assignment. Conversely, in the normative study release from final 
examination was selected over points toward the course grade 75 percent 
of the time. 

Evidence from these experiments and previous research suggests that 
'incentive effects would be most evident for memory" tasks provided.the 
student is aware that memory is a task requirement and that it will be 
facilitated by rehearsal. The precire effect of using external incen- 
tives with concept-classifi cation or problem-solving taisks is not clear, 
but it is obviously related to the effectiveness of the instruction on 
the tasks, the apparent negative effect of incentives on tasks that 
require new applications^of rules or concepts, as observed in this study 
and in the Eubanks (1976) studies, indicates the need for additional 
investigations of the generalizability and reliability of this effect. 
Further studftof the effects of incentives on various types of tasks 
should cont^»e to identification of the most effective ways to 
enhance .leaiPfg in university settings. 
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student Responsis to Attitude Survey: 
Experiment I: Experimental Session 



Students circled numbers that appeared to the right of each statement 
as follows: 



1 - strongly agree with statement 

2 = agree with statement 

3 = neither agree nor disagree 



4 = disagree with statement 

5 = strongly disagree with 

statement 







Ke 1 ateci 


unre i a tea 


I O ta 1 


1. I. learned a lot from this program. 




2.88 


2.69 


2.78 






3.00 


2.94 


2.97 








C..OC. 


C . OO 


2. I enjoyed working through this 


I 


3.38 


3.19 


3.28 


program. 


NI 


3.19 


3.31 


3.25 






3.28 


3.25 


3.26 


3. I knew much of this content before 


I 


3.88 


3.94 


3.91 


I took this program. 


NI 


3.19 


4.19 


3.69 




. 3.54 


4.06 


3.80 


4. I was motivated to do well on this 


I 


2.75 


2.50 


2.62 


program. 


NI 


3.25- 


3.06 


3.16 






3.00 


2.78 


2.89 


5. It was easy to understand the 


I 


3.38 


3.75 


3.56 


terminology used in this program. 


NI 


3.44 


3.19 


3.32 






3.41 


3.47 . 


3.44 


6, The instruction was presented in 


I 


2.88 


2.69 


2.78 


a clear format. 


NI 


3.12 


2.06 


2.59 






3.00* 


2.38* 


2.68 



7. 


I felt frustrated as I worked 


I 


2.56 


3.00 


2. 


78 




through this program. 


NI 


2.94 


2.94 


2. 


94 








2.75 


2.97 


2. 


86 


8/ 


I would have preferred learning the 


I 


2.50 


2.31 


2. 


40 




content of this program through 


NI 


2.12 


3.00 


2. 


56 




the lectur'^-^discu^sion approach. 




2.31 


2.66 


2. 


48 


9. 


I tried hard to learn the content 


I 


1.94 


2.. 38 


2. 


16 




from this program. ^ 


NI 


2.06 


" 2.69 


2. 


38 






2.00** 


2.54** 


2. 


27 



I - Incentive Treatment; NI = No Incentive Treatment. 
*£<.05 **R<.01 3g 



Student Responses to Attitude Survey: 
Experiment I: Follow-Up Session 



Students circled numbers that appeared 
as follows; • 

1 = strongly agree with statement 

2 = agree with statement 

3 = neither agree nor disagree 



to the right of each statement 

4 = disagree with statement 

5 = strongly disagree with 

"statement 



1. I learned a lot from this program. I 



2. I enjoyed ^working through this 
program. ' - 



I knew much of this content before 
I took this program. 



I was motivated to do well on this 
program. 



It was easy' to understand the 
terminology used in this program. 



6. The instruction was presented in 
a c1 ear format. 



7. I felt frusl^rated as I worked 
through this program. 



8. I would have preferred learning the 
content of this program through 
the lecture-discussion approach. 

9- I tried hard to learn the content 
from this program. 



NT 



I 

NI 



NI 



I 

NI 



NI 



NI 



I 

NI 



I 

NI 



I 

m 



Related 


Unrelated 


2.38 
2.94 
2.66 


2.38 
" 2.62 
2.50 


2.69 
3.31 
3.00' 


3.12 ' 

3.19 

3.16 


3.12 
3.19 
3.16*** 


3.75 
4.00 
3.88*** 


2.06 
3.06 
2.56 ' _ 


2.75 
2.94 
2.84 


2.38 
3 . 38 

9 QQ 
c, * OO 


2.88 
3.19 

3 . Uh 


■ 2.25 
3.06 
2.66 


2.25 
2.12 
2.18 


3.00 
3.31 
3.16 


3.12 
3.12 
3.12 


2.50 
2.00 
2.25* 


3.06 
2.62 
2.84* 


.1.56 
2.56 
2.06 


2.25' 
2.31- 
2.289. 



Total 

2.38 
2.78 
2758" 

2.90 
3.25 
3.08 

3.44 ' 

3.60 

3.52 

2.40** 
3.00* * 
2.70. 

2.63** 
3.28* * 
2.96 

2.25 
2.59 
2.42 



3. 
3. 



06 
22 



3.14 

2.78 
2.31 
2.54- 

1.90* 
2.44* 

2A7 



I = Incentive Treatment; NI - No Incentive Treatment 

*P<.05 **£<.03 ***£<. 002 
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APPENDIX B 
DIRECTIONS: EXPERIMENT 1 
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OIRECTIORS 

,'.*••> 
This Instruction*! program i, on* of two program 
dtvtlopod to dmfon^tnU prJnclpi,, of Instruction for tho Competency 
Basodt Instruction courso. Ont progran (Current Concepts in Measur«nwit 
and Evoluatloir) covort contant from Unit 3- You ^^'L^iJ'^^J^^'^ 
this content on tho Unit 3 t«$t and on tho flnsl oxaolMtion. The othor 
progrw (Tht Stnicturo and Function of the Eyo) covor? contwt that Is not 
reUttd to tho coars*-^ Othtr than the twt you tako when you compitto 
tho prtwraa, thort win be no furthtr t«st1ng on tho oantimt. You will 
CQRplota.one Qroqn» during this class mttting and tho other during tho 
next class RMtln^- 

Tho results obtained from the two program will ^'^.^J buis for 
discussions of Instructlonel principles in the fourth unit of the coursed 
Partiapatlon In both related and unrelated-progra^ is necisMry^ fbr an 
undorstindlng of tho importance of certain Instructional principles, 

Aftsr you hay« cowplettd the instructional program, you win be 
testad on Its contoni:- If you do well enough on tho tast. you ;^ii] 
recolve 10 points toward your course grade.* ^ 

This booklot dtals with the distinctions betwtart serious measure*' 
a»nt and evaluation concapts. tt taachas content which win enable you 
to Identify appropriate test Itean and to select tasa for your Instruc* 
tlonal purposes. P^-acrtce questions are Inserted PJ'^J**^??!!^ the 
text. Use the follo*^J»^ steps in working through the booklet. 

(1) Reed tft« textual material. ^ 

(2) Read the question and decide which alternative Is corr^. 

(3) ^lark your answer on the Pnjgram Answer Sheet using 
special pan provided.' PLEASE GO NtT IN THIS aOQw ct 

(4) Proceed to the next textual material and p«P«at steps 1-3. 

If you do not understand how to woHc^trtrough the program or how 
to use the Program Answer Sheet or special pen, ralsa your hand and ask 
the instructor to help you. 

PleaseTdo not begin working until you are told to do so. 

^S^DY TWE PROGRAff FOR AS UQp^Q ^S YOU ^AMT TO- '^'hen you have 
completed the' entire book, record the time shown on the board- and 
signal the instructor. Jou win then be given a short tes; to deter- 
nrlne riow effective the program was in teaching the various rneaaupement 
and eyaJuatlon conceots. Youmay leave when you nave finished the test. 
'. if' f 

♦>h1s statement was omitted in the no-incent1ve grotip. 
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" OIRECTICWS . » . 

This Initnictlonil pragrw is on« ^ Pn)grams that have bctfi 
d«v«lop«<* to dtmonstratt prIncipiM Instructloii fgr tha Corop«t«iicy 
Based Instruction Course. One prograw (Current Concepts in MeasureMit 
and Evaluation) covers content from Unit 3. You wti] be tested over this 
content on the Unit 3 test and on the fl^l «**«^n«t1on. The other program 
(The Stnictur* and Function of the £y«) ^^"f*^ <^ontent that is not r^la«<* 
to the course, other then the test you take v^hen you complete the pro- 
gnei, ^•'^ ^] no further testing on the content- You will cxm^^^ 
one progrM dur1n9 this class meeting the other during the next 
class meeting. 

The results obtained frm the b#o progrjw basis /or 

discussiortt of instructional pHnciplts in the fourth unit of the coor»«- 
Particlp«t1on in both related and unrelated Programs is necessary for an 
<inder3taftd1ng of the importance of certain instructional pHnciples, 

After xou have completed the instnictioijal pnj^,^, you will be 
tested on its content. If you do well enough on the test, you will 
recaive lO points toward your paurse grade.* 

This booldet deals with the stnicture and function of the eye. ft 
teaches content with which you probably have little pridr knowledge; 
therefore, it win provide a useful basns for ,a discussion of instmc* 
tional principles, n,, text mateHal is P»^snted paragraoft by paragrap** 
In small 5teps. At the end of each paragraph, you will find a multipl*- 
cnoice question. Th, paragraph of the text plus the multlple-nrhoice 

question is referred to as a fraow. In working through each frame, you 

^ill take the following sUps: ' y — " " 

(1.) Read the 

paragraph of text material. 

(2) Read the question and the five (S) alternatives of the 
text question., 

(3) Decide which alternative is correc^. 

(4) Mark your answer on:,the answer J^eet using the special pen 
provided, 00 NOT MARK tN TWI5 BOOKLET. (5^^ ^he special 
directions on the answer sneet.) tou may re-examine a text 
paragraph as much as you tike before ansv^pg the question. 

(^) Proceed to the next frame and repeat st^pj 

NOTE: There Is ofTTy*" )ne correct answer for each question. 




- if you do not understand how to work through the program or how to 
use the answer sheet and special pen. raisfryour hand and ask the Instrtjc- 
tor to help you. > . 

Please do not^^in working until you are told to do so. 

StUOr mz program for as long as you want, when you have completed 
the entire booklet, record the time shown on the boar^ and signal the 
instructor. You win then be given a short tast to'determin^how effec-. 
tive the program was in teaching you the content. Tiay/leave when 
you have finished the test. 7 f 

♦This statement did not appear for students in the no-incentive 
treatment group. - 

J 
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INCENTIVE PREFERENCE MEASURE AND 
MEAN RATINGS FOR INCENTIVES 
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INCENTIVE PREFERENCE MEASURE , ' 

^.L^.'iZt^^ you will receive two chapter, of salf-lnstructlon to' take home 
and study. Each chapter has a ^O-item posttest. You will take both tesS 
2;„IlI!n^^;. ?® ^"^"^ 2 chapters covers the unit objectives for 

Sequencing Instruction.- which are Included on 
the unit test iind final ejcamination, ^ o" 

?Ji ^^"^1? which 'represents how you would feel 

uJe^e s^leTl"* ^•^l ^" chapter tlm. 



Very 
Favorable 

1 L 



, Neutral 

J . 4 5 



Very 
Unfavorable 

6_ 7 



, . ^ Favorable 

a pos tlve letter of rererence for your placement 12 3 
file if your grade irt class is at least a 8 



Unfavorable 
5 6 7 



6 7 



1 2 3 4 5 6 7 
^ 2 3 4 5 6 7 



6 7 



the option to substitute your score on the 1 2 3 4 g 

40-itiiii test for your lowest score on a unit 
test in figuring your grade for the course. 

no reward at all- - 

an opportunity to assist the instructor with the 

grading of application assignments. Xh^j 
provides an excellent learning experience. 

^release from one application assignment You 1 2 3 4 s 

will receive a score equivalent to the highest 

score attained fay anyone in the class (20 noints 
. possible). uu poinTis 

^" ^ ^^''^""cuD?"^^^ ^rouo discussion 1 2 ' 3 ' 4 S e 7 

^ with the developer of the SWRL-Ginn, Kindergarten ' 
Reading Program on th^ topic "Objectives-based 
programs as they relata to individual learning 
styles and ethnic and socioeconomic background." 

Now, look at each Item again and put an t in xhe soace next to the item you would 
most prefer as a. reward for doing well. ^( check only one. ) - 

'^uld you Hk^.to have an opportuni ty to earn the incentive you most preferred 

when you completa the next self-instnjct1ona1 lessons? ^i^erred 

yes/no 



signfed 



44 4? 



Very v.O 
Favorable 



1.5 



2.0 



2.5 



3.0 



3.5 



4.0 



4.5 



5.0 



5.5 




_ Substitute a test score (1.58) 54% 
— - Release from assignment (1.66) 3'5% 



-""Letter of reference (2.50) 11%. 



— — Assisting the instructor (4.24) 0% 
_ Discussion with authority (4.49) 0% 



r: No reward (5.60) 0% 



Very ' 
Unfavorabl e 



T 

'.0 — 1— 



Figure 1. Mean values for 6 incentives derived through rating oh 
7-point scale and percentage of students who selected 
each incentive as first preference. 
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. DIRECTIONS : ' 

. Study the materials in Chapter 1 : ANALYZING aVd SEQUENCING LEARNER 
BEHAVIOR.* You will be tested over this content during the next class 
period. IF YOU SCORE WELL (at least 80 percent corredt), YOU WILL 
■RECEIVE THE REWARD YOU SELECTED. 

The reward you selected is checked (X) below. - ' ! 



ji positive letter of reference 



for your placement 



file if your g^ade in class. is at least a B. 

the option to substitute your score qn the 40-'item 

test for your lowest, score oh unit test in figuring . 
■ . : , your grade for the course. ' * 

^release from one application assignment . You will 

receive a score equivalent to the highest score 
attained by anyone in the class (20 points possible). 

Remember, whether or not you rece4:ve-the- rewa^rd-you'' selected will be 
determined solely upon your performance on the Chapter 1 : ANALYZING AND 
SEQUENCING LEARNER BEHAVIOR.* Ycfu will take the other test, but. your 
^ore on that test cannot be used to determine whether you receive the 
reward. 

--^Please complete Chapier 1 before you -begin Chapter 2/ 

Please keep an accurate record of the amount^of time you spend oo 
each chapter. Notice, there is a place on the answer sheet to record(^ 
your time on each chapter. , 

NOW, WRITE YOUR NAME AND THE TIME IT IS NOW ON THE ANSWER SHEET. 
Use the enclosed card to cover the answers whije you work. 

> YOU ARE NOW READY TO BEGIN. ' • " 

*The chapter number and title varied for the four orders of 
presentation. 



DIRECTIONS 



Study the materials in Chapter 1: ANAi,YZING AND SEQUENdlNG 
LEARNER BEHAVIOR.* You will be tested over this content during 
the next class period, hi^ YOUR lERFORMANCE ON THE TUESDAY TEST 
ON ANALYZING AND SEQUENCING LEARNER BEHAVIOR* WILL NOT AFFECT 
YOUR COURSE GRADE IN ANY WAY. " - ' 

Use the program answer" sheet to record your responses to 
the practice exercises. DO NOT WRITE IN THIS BOOKLET. 

. Please keep ah adcuraite record qf . the TOTAL time you spend, 
studying this chapter. There is a place on the answer sheet to 
record your time. 

Please complete Chapter 1 before you begin Chapter 2. 

NOW, WRITE YJ3UR NAME AND THE TIME IT IS NOW ON THE^ANSWER 
SHEET. Use the enclosed card to cover the answers while you 
work. 

, YOU ARE NOW READY TO BEGIN. . 




*The chapter number and title varied for the four orders of 
presentation. 
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student Responsesl tb Attitude Survey: Experiment 3 

■ " ' ■ - ■ ■» • 

Students circle ntimbers t^t appeared to the^right of each statement as fpMows.: 



T * 5trongV 39ree with staT;ement 

Z = agree with statement 

3 « neither agree nor disagree 



•4 = disagree with statement; 
5 = strongly disay^ee with '.- 
statement A , 



Incentive^ No Incentive 



1 . I lea'rned a lot about writing objectives from this 

unit. 

2. l ej)joye<l the ins.truction in this unit. 

3. The instruction for this unit was presented in a 

clear' manner. 

4*. ' I tried hfrd tg leani the skills taught in this unit. 
5/ 'In the future, the instructor should advise all students 

to attend practice sessions. 
6. I would have preferred that the instruction for this 

unit be given through the > 1 ec tune method . 



Students who did attend practice sessions responded to 
these stacenients: 

7. The practice- sessions increased my understanding of 

the mater fa 1. 

8. I shouM not have attended the practice sessions; 



Students who did not attend practice resoondad to 
stat^nft: 

9. I should have attended the practice sessions. 



thil 



Students in the incentive treatment responded to thfs 

statement: ■ . . . . 

■ * ■ 

10. Knowing that I could eam relelse from the final 
examination for good performance on the unit- test 
Influenced me to try: (check one) 

n iuch harder than usual. ^ not* as hard as* usual 

h ardej* than, usual . not nearly as hard ' 

about as hard as' usual. as usual - 









1.72 


1.78'. ■ 


'1.65 


1.32 


1.34 


l.a2 


1.72 


. 2.50 ■ 


2.37 






4.25. 


4.06 ■ 


Incentive^ 


No Incentive' 


1.72.* 


1.28 V 



4.50 
Incentive^ 

' "'3.75 
Incentive^ 



2.25 



4.45 
No Incentive^ 

2.71 

No incentive" 



Students in the ho-incenHye treatment responded to this 
stat€8ncnt: 

11. If I could have earned release from the final 

' examination for good perfoman^c^ on this test, I --^^ 
' would have tried: (check one) 

much harder than usual. 

' ] ia rder than usual, 
about has hard usual. 



_not*as nard as usu:j1 
jiot nearly 2S hard^ 
' as usuaV.- 



= 23 
.02 



29 



- 22 -n = 4 
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OIRECriQNS 



This ptcktt contains an Instructional program covering the four objectlvas for 
Unit 2. You may b« able to mastar tha unit objectlvas simply by studying tha 
matarlal in tha packat. For thosa parsons warvt additional practica on th^a 
objactivas, class tloa will ba usad for optional attlvltias that provlda such 
practica. 

Tha taat covaring Unit 2 will ba ^glvan on Uadnasday, February 9, If you scora 
at least 80 percent on tha unit test, you will ba excused from taking tha final 
axa«inat1on for this course. Except for class on Friday, January 28, you will not 
be required to attend class again until the class session for the unit tast, 
Wednesday* February 9. 

Class sessions for tha purpose of providing feedback on the instructional 
program and additional practica on the four objectives will be as follow: 

Monday, January 31 pages 1-20 (objectives 1-3) 

Wednesday. February 2 (no class) 

FHday. February 4 oagas 21-27 (objective 4) 

Monday. February 7 pages 21-27 (objective 4). 

If you miss several Items when completing pages 1-20 in the program, it is 
likely that you can profit from the practice session on January 31. Similarly, 
the practice sessions on Fetm^rj 4 and February 7 should be helpful If you have 
difficulty with the Items on pages 21-27. Of course, you are welcome to partici- 
pate In these sessions even If you do extremely well throughout the program. 

Please keep a record of (1) the time you spend working through the program 
and (2) 'the time you spend reviewing for the tast. Use the space below to 
record the tine. 

Time spent ^/wrklng through the program the first time: _j 



Time spent reviewing the material: ^ 

*> 

When you answer an item or set of Items in the program, mark ydur responses 
before looking at tne answers. Use the enclosed card ia cover the answer while 
you work. MARK YOUR ANSWEP^ OIRECTLY IN THE BOOKLET . Please leave your original 
answer to an item. If you wish to make any changes after looking at the answer, 
please do so with a different colored pen or pencil. 

If you want to take a break while working through the program, the best 
places to do so are at the end of Instruction on an objective. These places are 
indicated in the program by the word "BREAK." 

You should finish instruction on the first thr-e objectives (paaes 1-20) 
before Monday , January 31.^ 
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^ DIRECTIONS ' 

This packet contains an Instructional program covering the four objectives 
for Unit 2. You may be able to master the unit objectives simply by studying 
the material in the packet. For those persons who want additional practice on 
tliese objectives, class time will be used for optional activities that provide 
such practice. 

The test covering Unit 2 will be given on Thursday, February 10 . Some 
students will have an opportunity to earn release from the course final 
examination for good performance on the test for this unit. You are not among 
this group. However, you will have your opportunity to earn release from the 
final examination for good performance on one of the other unit tests. 

The class session on February 10 for the unit test Is the next session 
you will be required to attend. The test will cover only the four objectives 
taught in the Instructional program In your packet. The items on the test 
will. be identical In type to the items that you answer in the program. If 
you do well In the program, it is an indication that you should do well on 
the test. 

Class' sessions for the purpose of providing feedback on the instructional 
program and additional practice on the four objectives will be as follows: 

Tuesday, February 1 pages 1-20 (objectives 1-3) 

Thursday, February 3 pages 21-27 (objective 4) 

Tuesday, February 3 pages 21-27 (Objective 4) 

If you miss several items when completing aages 1-20 in the program, it is 
likely that you can profit from the practice session on February 1. Similarly, 
the practice sessions on Febraury 3 and February 8 should be helpful if .you 
have difficulty with the items on pag^s 21-27. Of course, you are welcome 
to participate in these sessions even if you do extremely well throughout 
the program. 

Please keep a record of (1) the time you spend working through the 
program and (2) the, time you spend reviewing for the test. Use the space 
• below to record the time. 

Time spent working through the program We first time: : 

Time spent reviewing the material: : 

When you answer an item or set of items in the program, mark your responses 
before lookino at the answers. Use the enclosed card to cover the answer while 
you work. MARK YOUR ANSWERS DIRECTLY IN THE SOOKLET. Please leave your original 
answer to an item. If you wish to make any changes after looking at the answer, 
please do so with a different colored pen or pencil. 

If you want to take a break while working through the program, the best 
places to do so are at the end of instruction on an objective. These places are 
indicated in the program by the word "BREAK." 

You should finish instrjction on the first three objectives {pages 1-20) 
before Tuesday, February 1. 
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